Mouth Localization for Appearance-based Lip Motion Analysis
نویسندگان
چکیده
Analysis of lip motions can be deployed in a variety of applications, e. g. visual speech reading or liveness verification as part of a person authentication system. When utilizing appearance-based features to describe lip shapes (visemes), robustly detecting the position of the mouth center is an inevitable part of this task. In this paper we present an algorithm for mouth localization as part of a person authentication system using gray-scale morphology and amplitude projection of the mouth region. Experimental results demonstrate the effectiveness of the proposed algorithm under simulated realistic conditions. Our system operates on face images captured under near infrared illumination. Key–Words: Infrared imaging, Visual speech recognition, Mouth detection
منابع مشابه
Mouth Region Localization based on Gabor Features and Active Appearance Models
We propose a combined knowledge, feature and appearancebased method for accurate localization of the mouth region from a face image obtained using a web camera. First, using a knowledge-based approach based on geometrical properties of a regular face, we prune the mouth search region by extracting a rough segment where the mouth should be located in the given face. Next, assuming the mouth is c...
متن کاملLip motion modeling and speech driven estimation
Recent advances in joint acoustical/visual analysis for model-based lip motion synthesis is presented. The 2D lip motion eld is modeled as a linear combination of a low dimensional motion basis computed through Principal Component Analysis (PCA). The vector of PCA coe cients is expressed as a function of a limited set of articulatory parameters which describe the external appearance of the mout...
متن کاملRobust Lip Tracking by Combining Shape, Color and Motion
Accurately tracking facial features requires coping with the large variation in appearance across subjects and the combination of rigid and non-rigid motion. In this paper, we describe our work toward developing a robust method of tracking facial features, in particular, lip contours, by using a multi-state mouth model and combining lip color, shape and motion information. Three lip states are ...
متن کاملAutomatic lip localization under face illumination with shadow consideration
Lip-reading has potential attractive applications in information security, speech recognition, secret communication and so forth. To build an automatic lip-reading system, one key issue is how to locate the lip region, particularly under the changing illumination condition. Empirical studies have shown that the recognition rate of a lipreading system greatly relies on the accuracy of the lip lo...
متن کاملFacial Landmark Localization
Face detection and recognition is a vibrant area of biometrics with active research and commercial efforts over the last 20 years. The task of face detection is to search faces in images, reporting their positions by a bounding box. Recent studies [19, 31] have shown that face detection has already been a state-of-the-art technology in both accuracy and speed. However, face detection is not suf...
متن کامل